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I . INTRODUCTION 



This is the final report on Phase XX of a study of library consortia in 



higher education. The study was sponsored by the U. S, Office of Education 
and conducted by System Development Corporation. This report, which covers 
Phase IT activities from 16 July 1971 to 31 October 1971, is the last of 
a series of four formal reports; 



This report supplements and largely supersedes the three previously submitted 
project reports. The reader may wish to refer to the Phase I Progress and 
Final Reports for details of the questionnaire surveys and Directory 
production and to the Phase II Progress Report for a review of the case 
study interviews. 

The two phases of the study have involved: 1) a questionnaire study to 

identify all academic library consortia and to describe and define their 
activities; and 2) a case-study analysis of 15 selected consortia to help 
determine the usefulness and effectiveness of academic library consortia. 

The two major products resulting from the project are the Directory of 



• Phase X Progress Report on Study of Academic Library Consortia 
(TM-4597/COO/OO) i submitted to USOE on 10 August 1970. 



a Phase IX Progress Report on Study of Academic Library Consortia 
(TM-4597/001/00) ; submitted to USOE on 5 August 1971. 



• Phase 1 Final Report on Study of Academic Library Consortia 
(TM-4597/QQ2/GG) accompanied by Directory of Academic Library 
Consortia (TM-4597/003/00) ; submitted to USOE on 14 October 1971. 
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Academic Library Consortia (the Table of Contents is included as Appendix A 
to this document) and the Guidelines for the Devu.lop.nent of Academic Library 
Consortia , submitted with this document (the Abstract and Table of Contents are 
included as Appendix B to this report.) 

The schedules of Phase 1 and XI project activities included in previous project 
reports, are presented as Figure 1. 
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II. SUMMARY OF PHASE I ACTIVITIES AND FINDINGS 

Phase I involved the design and administration of two questionnaires. 

The first questionnaire was directed to 2600 colleges and universities 
throughout the continental United States to identify existing academic 
library consortia to which the institutions belong. The first questionnaire 
was mailed out in February 1971, followed up by a second mailing, and was 
fully processed by the middle of May. From this first survey, 409 coopera- 
tives were Identified as possible aeadamic library consortia. Without 
more information as to membership and activities, it was difficult to 
determine which groups fell within the academic scope of our survey. There- 
fore, to ensure that all bona fide academic library consortia would be 
included in the second survey, a second questionnaire — directed to con- 
sortia headquarters — was sent to each of the 409 groups. 

During the screening process of the second questionnaire we found it 
necessary to define clearly the scope of "academic library consortium" in 
order to make the necessary decisions on directory content. To ensure 
compliance with original USOE intentions for the scope of the study, we 
developed a set of criteria for inclusion and obtained concurrence on 
the criteria from USOE. The criteria selected are listed below. 



1. The participating institutions must be autonomous, that is, they 
must report to separate Boards of Regents or other separate, 
higher level governing body agencies . 



2. The consortium membership population must contain a preponderancft 
(50 percent or more) of academic library membership. 



3, 




The consortium stage of development must be solidified beyond the 
early talking or exploratory stages. The group must have decided 
that, indeed, it is a cooperative entity and is at least planning 
joint activities, 

7 
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4* The consortium must be organised to pursue activities or services 
that are of benefit to the academic participants involved * 

5. There must be two or more libraries involved with aetivites 
extending beyond traditional interlibrary loan, as defined by 
ALA rules . 

6. If the library as a group is part of a higher level, multipurpose 
higher education consortium, one component must be a defined 
library committee with goals of improved library services. 

The major finding from Phase I— other than the range of academic library 
consortia activities and membership statistics reported in the Directory- — 
was that, in addition to consortia defined as academic, there are many other 
kinds of cooperatives of potential interest to the library community. For 
example, there are cooperative aetivites among the multiple campuses of 
single institutions, there are cooperatives that include a preponderance 
of special and public libraries in addition to academic libraries, and 
there are cooperatives that do not have academic libraries among the mem- 
bership mix. 

Regardless of the kinds of libraries composing the membership, the goals 
and objectives remain for the most part the same as those of academic 
library consortia. Two fairly typical sets of objectives are listed below : 



m Assist member libraries in the selection of materials, 
m Purchase, catalog, and process library materials, 

• Coordinate cooperative acquisitions, interlibrary loans, 
and the reproduction of materials for the member libraries, 

m Promote the development of programs for the expanded use of 
library resources, 

• Stimulate the improvement of library facilities and services. 




• Cooperate in the development of library personnel. 



e 



i- 
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2, • Provide, through cooperative acquisition by voluntary agreement, 

materials beyond the reach of the individual libraries. 

• Achieve economies in the use of resources, both human and- 
material. 

• Facilitate sharing of materials among members of the group. 

The Directory of Acade mi c Library Consortia that was produced from this 
study has played a large part in Identifying and describing the range of 
consortia existing in the U, S, today. We strongly recommend that a 
second directory be produced that identifies and describes (by type) the 
remaining major library cooperatives that have academic libraries as 
members — so that the two books together identify the universe of academic 
library consortia including network activities among academic and other 
kinds of libraries. 

In comparing the cooperative activities considered "most desirable" by 
consortium members and nonmembers with actual consortium activities being 
undertaken (and reported in the Directory) , we found a high degree of 
correspondence. The consortia are apparently being responsive to the 
proposed needs of the participating libraries. 

Table 1 illustrates this correspondence. 
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TABLE 1. RANKED SERVICES DESIRED FROM CONSORTIUM MEMBERSHIP 



SERVICES 


RANKING IN ORDER OF DESIRABILITY 
TO MEMBERS TO NONMEMBERS 


Reciprocal Borrowing Privileges 


1 


1 


Cataloging Services 


2 


7 


Production and Maintenance of Union Lists 






and Directories 


3 


2 


Acquisitions 


4 


5 


Unrestricted Interlibrary Loans 


5 


4 


Reference Services 


6 


8 


Micro filming 


7 


11 


Special Communications Services (e,g, f Tele- 
type i Telefacsimile , or Tel-Autograph) 


8 


6 


Photocopying Service 


9 


9 


Storage of Little-Used Materials 


10 


12 


User Orientation Programs 


11 


10 


Clearinghouse (e.g., for Gifts, Exchanges, 
or Language Translations) 


12 


3 


Personnel Training and Upgrading 


13 


16 


Joint Research Projects (e.g.. Automation) 


14 


13 


Bindery Service 


15 


18 


Delivery Services 


16 


15 


Publication Program (e.g.. Bibliography of 
Special Collection) 


17 


17 


Recruitment Programs 


18 


19 


Operation of a Bibliographic Center 


19 


14 



10 
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III. SUMMARY OF PHASE II ACTIVITIES 

A. TASK Is CASE-STUDY DATA COLLECTION 
1. Planning 

Two major activities ware associated with the selection of and preparation 
for the 15 consortia to be visited. The first activity involved the design 
and testing of an unstructured interview guide— the field site visit 
checklist* The purpose of the checklist was to ensure the efficiency of 
the data gathering activity by promoting reply to all the questions for 
which information was needed. The second activity was the analysis and 
selection of the 15 consortia. 



The checklist— included as Attachment 4 to the Phase IX Progress report 
of the study— was designed in two parts: one directed to the consortium 
headquarters and the other to member libraries. Early in the project 
initial draft versions of the checklist and questionnaires were designed 
and pretested by project staff in multiple field site situations. 



Persons visited were: 



Dr. Alan Ferguson, Director, New England Board of Higher Education 
(NEBHE) 

Mr. Merle Boy land and Mr. James Kennedy, University of Massachusetts, 
Amherst 

Mr. Sam Goldstein, former Director, NELINET (New England Library 
Information Network) 

Mr. William Nugent and Mr. Lawrence Buckland, Inforonics, Inc., 
Maynard, Massachusetts 

Mr. Donald Vincent, Librarian, University of New Hanpshire, Durham, 
(NELINET member) 

Mr. Witold Sworakowaki, Hoover Institution, Stanford University, 
executive secretary of the consortium of Western Colleges and 
Universities 
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Mr, Lewis Patterson, Program Director, KCRCHE (Kansas City Regional 
Council for Higher Education) 

Mr. Harold Smith, Librarian, KCRCHE 

Mr, Frederick Kilgour, Director, OCLC (Ohio College Library Center) 

Dr, Louis C, Branscomb, Director of the Board of Trustees, (OCLC) 

Mr, Dale Shaffer, Librarian, Capitol University (OCLC member) 

Sister Stella Spangler, Librarian, Eastern Ohio Dominican College 
(OCLC member) 

Brother Nartker, Librarian, University of Dayton (OCLC member and 
Dayton-Miami Valley Consortium member) 

Mr, Jim Dodson, Librarian, Wright Stage University (OCLC me mb er 
and Dayton-Miami Valley Consortium member) 

Darrell H. Lemke, Coordinator of Library Programs, Consortium of 
Universities, Washington, D, C, 

As previously reported all of the discussions were productive and helpful 
in highlighting considerations important both for refining the context 
of the field site visit checklist and for developing the structure of the 
guidelines document. Enough data were collected during these interviews j 
that NELINET , KCRCHE, OCLC and Dayton— Miami did not need to be revisited^ any 
further specific questions to these consortia were handled by telephone. 

In refining the checklist we were able to determine the preferred sequence for 
asking questions, and to devise a format suitable for notetaking. It was 
initially planned to have our project consultants review and co mm ent on the 
fi©ld site visit checklist. However, since the checklist proved adequate 
with only a few minor changes, it seemed more propitious in terms of time 
and benefit to the project to have them review a draft of the guidelines. 

The USOE project monitor and the consultants were contacted, and all -agreed 
to the change. 




The checklist design activity also enabled us to isolate the variables and 
factors of interest in selecting consortia to visit. They included but 
were not limited tot 

Breadth and scope of the consortium 1 s purpose and objectives 
Existence of centralized headquarters 
Number of members 

Geographic distance between participants 
Membership in multipurpose higher education consortia 
Amount, source and stability of funding 

Homogeneity of participating libraries, e,g., with respect to 
type and size 

/ 

Length of existence 

Kinds of agreements and rules for participation 
Current mix of planned and operating activities 
Consortium staffing 

Consortium views oh problems and recommended solutions 
Extent of direct services from the headquarters facility (if any) 

Extent of automation 

2, Selection of 15 Consortia 

It was important to us that the field site selections and majority of visits 
wait until the Phase I questionnaires were returned and interpreted in 
order to determine which groups would represent the broadest coverage of 
characteristics for study. After the questionnaires were returned, a 
detailed analysis of the characteristics of the various consortia was 
conducted, with the goal of selecting, a set to be visited that would 
encompass the full range of objectives, operating philosophies and problems 
addressed by the study. A final group was selected by SDC, and approved by USOE 
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Associated Collages of Central Kansas 
115 East Marlin 
McPherson, Kansas 67460 

Dr. Eoward W. Johnston, Executive Director 

Collection and Evaluation of Materials on Black Americans 
Alabama A & M University 
Huntsville , Alabama 35762 
Winford Ashford, Coordinator 



Colorado Academic Libraries Book Processing Center 
Norlin Library 
University of Colorado 
Boulder, Colorado 80302 
Joseph A, Hewitt, Coordinator 

Common Library of the Graduate Theological Union 
2451 Ridge Road 
Berkeley, California 94709 
J, Stillson Judah, Head Librarian 

Consortium of Universities 

1717 Massachusetts Avenue, N.W. 

Washington, D.C, 20036 
Darrell Lerake, Coordinator 

Consortium of Western Colleges and Universities 
Stanford University 
Palo Alto, California 94305 
Witold Sworakowski, Director 

Day ton-Miami Valley Consortium Libraries 
Antioch College 
Library 

Yellow Springs, Ohio 45387 

Bruce Thomas , Chairman, Executive Committee 

Five Associated University Libraries (PAUL) 

106 Roney Lane • 

Syracuse, New York 13210 

Glyn T, Evans, Coordinator of Library Systems 

Kansas City Regional Gotmell for Higher Education (KCRCHE) 
4901 Main Street, Suite 320 
Kansas City, Missouri 64112 
Henry Hals ted. Vice President 




Mississippi Valley Libraries Cooperative Service 
Lincoln University Library 
Jefferson City, Missouri 65101 

(Mrs,) Freddye C. Ashford, Acting University Librarian 

New England Library Information Network (NELINET) 

New England Board of Higher Education 
20 Walnut Street 
Wellesley, Massachusetts 02181 
Ronald Miller, Director 

New Hampshire College and University Council (NHCUC) 

2321 Elm Street 

Manchester , New Hampshire 03104 

Steven Hillgard, Chairman, Library Committee 

Northwest Association of Private Colleges and Universities (NAPCU) 
5000 North Willamette Boulevard 
Portland, Oregon 97203 
Eric Schauer , Executive Director 

Ohio College Library Center (OCLC) 

1314 Kinnear Road 
Columbus , Ohio 43212 
Frederick G, Rilgour, Director 

Tri-State College Library Cooperative 
Holy Family College Library 
Grant & Frankf ord Avenues 
Philadelphia, Pennsylvania 19114 
Sister M, Jane, CSFN, President 
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A comparative analysis of many consortia was made before this final set was 
decided upon. Statistics were extracted from questionnaires of the various 
respondents and characteristics were analyzed. The analytical methodology 
employed is reflected in Figure 2, which contains an initial cut at 
statistical inputs gleaned from the questionnaires received from the consortia 
to be visited. The consortia either visited or that were- re ma ining to be 
visited are listed in abbreviated form on the left| the classes of data and 
the characteristics themselves are listed across the top. Note the multiple 
characteristics present: for example, groups with legal agreements both 

with and without rules for participation, and groups without legal agreements 
also with and without rules for participation. Also, one can see, in examining 
operational or planned activities, that most consortia have reciprocal 
borrowing, union lists, or expanded interlibrary loan. Furthermore, there 
is a close correlation between the activities of current consortia and the 
desired consortia activities of nonconsorting libraries. After taking these 
multiple characteristics into account in the selection process, we attempted 
to achiave a good geographical distribution across the United States, Loca- 
tions of the consortia selected are shown in Figure 3. By examining the 
permutations of all. characteristics communicated to us, we were able to select 
® ®®t to study in depth that contained the fullest possible range available 
in a grouping of 15. 



The interviews were carried out by a team of two librarian/systems analysts , 
or one librarian systems analyst with full tape-recorded backup. One day 
was usually spent at the consortium headquarters (if there was one), 
interviewing the director and members of the consortium staff ; the following 
day was spent interviewing the library directors and other librarians at 
one or more member libraries. The kinds of people interviewed at any one 
consortium were a mix of the following: 




Director (or Coordinator) of the academic library consortium 



Director of the education consortium 



• 3 ', £ £U. 




m Faculty member who represented the librarians to rhe education consorts 
© Chairman of the library consortium 

© Director o£ the library consortium Board of Trustees 
m Library directors (who were members of the consortium) 

s 

m Library directors (who had been members and who had withdrawn) 

© Consortium staff 

© Librarians (cataloguer , reference librarian* archivist, head of 
acquisitions of technical processing) 



An attempt was made to interview individuals at any one consortium who 
were known to be dxsatisf ied or especially critical of the consortium as well 
as those who were satisfied, in order to get as complete a view of all 
sides of the consortium as possible* The interviews varied in length from 
1 to 4 1/2 hours | the total number of interviews was 58* (Of the librarian 
directors interviewed, three were members of more than one consortium*) 
Interview checklists were used to ensure that all areas of potential 
importance were covered in the interview. 

To help obtain frank and candid comments from the interviewees, we indicated 
that no information will be specifically attributed to them without their 
express permission* All trip reports were kept confidential, and when 
examples were presented in the Guidelines, the source and consortium identity 
remained anonymous. It is appropriate, however, to summarise important 
highlights gained from the visits that contributed to the design and content 
of the Guidelines* For example, most consortia seem to be multipurpose 
rather than single purpose* consortia directors visited have felt that it 
is easier to develop a multipurpose consortium because a variety of activities 
can help keep it going, Sise is important, since smaller groups permit a 
high degree of personal invovlement , With respect to members , there tend 
to be (1) aceepting/non-critical members who are pleased with the 
situation, (2) critically accepting members, and (3) neutral members . No 
single pattern or path of development has been encountered. 
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1. 

2 . 
3 . 



5 . 



6 . 

7 . 



8, 

9 . 



10 . 



u. 



12 , 



13 . 



14 . 

13 , 



NELINKT 

OCLC 

Day eon Miami Valley 
Kansas City Reg. Council 
Consortium of Western Colleges 
and Universities 
Colorado Academy Book Froe, 
Northwest Assoc, of Priv, 
Colleges and Universities 
FAUL 

New Hampshire College and 
University Council 
Consortium of Universities of 
Washington! D.C. 

Common Library of the Graduate 
Theological Union 
Tri^State College Library 
Cooperative 

Associated Colleges of 
Central Kansas 
Mississippi Valley 



Alabama Center for Higher 
Education (GEMBA) 



NOTE; F « Planned Activity 




(No, 5 incomplete, since q2 has not been received,). 
FT a Part tim& oe raonnyl 



*NQTE: 7 budget decrease from 250K to 2.8K 

10* 14. 15 not a separate library agreement 

11 has penalty for withdrawal and is currently revising agreement 

50K grant 69/70* 0 grant 70/71, 205JC application 71/72 
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1 . 



Northwest Association of 

Private Colleges and Universities LJ 



□Anchorage, Alaska 



2 . 



3. 



4. 




Common Library 
of the Graduate 
Theological 
Union ■ 



Colorado 

Academic 

Libraries 

Book 

Processing 
Center $ 



Consortium 
of Western 
Colleges and 
Universities 
(no data) 



Associated 
Colleges of 
Central Kansas 0 



6. Kansas City 
Regional Council 

for Higher Education I 

7, Mississippi Valley 
Libraries Cooperative 
Service ■ 



8. Alabama Center for Higher Education^ 
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B. TASK 2: CASE-STUDY REPORTING 

As previously mentioned , the results of each case— study interview contributed 
valuable inputs to the description of consortium activities, reported 
in the guidelines report Chapter III, and to the consortium development. At the 
conclusion of each visit, the study team met and prepared an informal but 
complete written synthesis of each consortium visited. This synthesis included 



1. Assurance that a clear view of each development step and all of 
its characteristics were present, 

2. Determination of how that visit modified or expanded our preliminary 
definitions of the development model and approaches to guidelines, 

3. Determination of any important new consortium characterisitcs that 
were realized. 

4. Notation of specific examples of development situations that could 
be cited anonymously In the guidelines report. 

This rather extensive post-visit analytical activity helped to ensure that 
the guidelines were based — to the fullest possible extent- — on comprehensive 
and valid information and experience. 



C, TASK 3: DESCRIPTION OF CONSORTIUM CHARACTERISTICS 

? 

For the purpose of providing a meaningful method of presentation, we 
divided these varous elements into the following information categories I 

• Purposes and Objectives 

• Organization and Staffing 

• Cooperative Functions 

• Support 

a Evaluation and Measurement 
@ Patterns of Development 

Our original intention was to present information under each of these headings 
as part of this Final Report, However, as our analysis of the data progressed 
and more results of our survey and interviews became available, it seemed 
more useful to integrate information in the above categories into the 
categories developed for the Guidelines document. In this way, we could 
present descriptive and prescriptive information together, giving support 
for our recommendations with each item of guidance we provided. Therefore, 
information in the original categories may be found in the Guidelines document 
(see Appendix 2 for Table of Contents), as indicated below: 

• Purposes and Objectives: Planning Phase, Step, 1. 

• Organization and Staffing: Planning Phase, Step 2; Development Phase, 

Step 2. 

9 Cooperative Functions: Chapter 111, Description of Consortium Activities 

• Support: Planning Phase, Steps 4 and 5, 

® Evaluation and Measurement: Operation and Evaluation Phase, 

9 Patterns of Development: Introduction, Chapter I. 
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D. TASK 4 1 DEVELOPMENT OF MODEL AND GUIDELINES 

At the end of the series of interviews, SDC staff members had collected 
1500 pages of typed tape transcriptions, representing interviews with 58 
people in the 15 consortia. This body of interview data was used in co mb ination 
with the data from the Phase 1 survey and with the available literature as 
a basis for the development of the Guidelines document. Sections of the 
1500 pages from the interviews were classified into various categories on 
the basis of the developmental step being discussed, and from these categories 
the first draft of the Guidelines was produced. Construction of a developmental 
model for academic library consortia preceded concurrently with the drafting 
and revision of the Guidelines document. As we learned more from our collected 
data, it became clear that no one model could he built at this time that would 
incorporate all the complexities and variations encountered. We therefore 
built a series of models to illustrate these complexities and variations. These 
models, accompanied by a discussion of our findings, appear in Section IV of 
this report and in the Introduction to the Guidelines document. 

Once the Guidelines were drafted, it was possible to correlate the contents 
of each step description with statistical material drawn from the Phase 1 
survey. As questions were raised by the interview data, they could be 
examined and, at times, resolved by careful analysis of the survey data. 

In those instances where we could not recoranend any of the procedures used 
by the various consortia, we made our recommendations on the basis of an 
application of well-recognized principles of system analysis and project managemen 

After an internal review and revision process, the draft was sent to five 
project consultants for review: 

Dr, Martha Boaz, Dean of the School of Library Science 

University of Southern California 



Dr. Donald Dividson, University Librarian 
University of California at Santa Barbara 
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Dr. William Paisley 

Institute for Communications Research 
Stanford University 

Dr. Ralph Parker, Dean of the 
School of Library Information Science 
University of Missouri 

Mr. Allen Veaner, Assistant Librarian for 
Bibliographic Services 
Stanford University 



In the accompanying letter, the consultants were given the following instructions 

"Please write your comments on the text, and return it to us with any 
additional comments you might care to make. We would appreciate your 
comments on : 

1. Interpretations we have made, or advice we have given, with 
which you disagree; 

2, Fuzzy concepts that need clarification; 

3. Things omitted that should be added; 

4, Your overall evaluation of the potential usefulness of the 
document, and what could be added to make it a better document." 

The five consultants returned their review cpoies with many helpful comments ; 

Lii&ir suggestions were carefully evaluated and, where possible, incorporated 
into the document. Helpful comments were also received from three 
faculty members of the Universtiy of California, Berkeley t 

1. Dr. Raynard C. Swank, Professor of Librarianship 

2, Dr. Patrick Wilson, Dean of the School of Librarianship 

3* Dr. Lotfi Zadeh, Professor of Electrical engineering and computer 
sciences 

'• / 
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E, TASK 5: PREPARATION OF PHASE IX REPORTS 

The formal reports required as part of the Phase 11 activities of the project 
consisted of a Progress Report, which was submitted to USOE on 5 August 1971, 
and this Final Report • The Guidelines for the Development of Academic Library 
Consortia , the major product of Phase II, is being submitted as a separate 
volume accompanying this report. 
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IV. SURVEY FINDINGS 



A, RANGE AND SCOPE OF CONSORTIUM ACTIVITIES 

Figure 4 is a composite model of a consortium mid illustrates 14 major char- 
acteristics (e.g, , type, area served, headquarters, etc.) by which academic 
library consortia can be described. Every academic library consortium can be 
described in terms of these characteristics. Staffing level, although an 
important variable, has not been listed as a characteristic, since it is highly 
interrelated with several other characteristics already listed, such as the 
existence of a centralised headquarters and the consortium budget level. 

Figure 5 presents consortia models that are based on the characteristics of 
"type” and "headquarters The model shows the configurations of library 
consortia that are either a member of a higher level education consortium or 
an independent entity, and are either with or without a centralized headquarters. 
These structures are discussed in greater detail in Chapter II of the Guidelines 
for the Development of Academic Library Consortia. 



In order to provide a manageable task, this study of library consortia had 
been initially limited to only those consortia which were predominately 
academic. Indeed, the SDC survey, the ease studies, and the literature on 
the topic of consortia (and networks) have revealed that the interrelationship 
of academic consortia— as well as academic libraries-- is extremely complex. 
Figure 5 illustrates the interrelationships that we encountered. For example. 
Library A is a member of an education consortium. Consortium 2, the libraries 
of which are engaged in only one cooperative activity! the development of 
a specific subject area. Library A is also a member of an academic library 
consortium. Consortium 1, that is in the process of providing extended inter- 
library loan and reciprocal borrowing privileges, as well as considering other 
possible activities. Finally, Library A is also a member of an academic 
library consortium. Consortium 3, that is concerned with centralized technical 
processing. Furthermore, Library A has had the option (selected by one of its 
sister libraries) to be a member of Consortium which consists of academic 
nnd public libraries. In the meantime. Consortium 3 is in the process of 
ne gotiating with Consortium 4, in order to benefit from the latter's recent ■ 
developmental accomplishments. -2 7 
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TYPE 


RULES FOR PARTICIPATION 


Member of Higher Level 


Rules for Participation 


Educational Consortium 


No Rules for Participation 


Independent Entity 




COMPUTER USAGE 


AREA SERVED 


City 


Has Computer 


Uses University Computer 


Region 


Uses Service Bureau 


State 


Does not Use Computer 


Interstate 


HEADQUARTERS 


MEMBERSHIP COUNT 


Centralised Headquarters 


10 or Fewer Members 


No Centralised Headquarters 


11 to 20 Members 


OBJECTIVES 


21 to 30 Members 
Over 30 Members 


Improved or Increased Service* 


ACTIVITIES 


Decreased Cost* 


STAGE OF DEVELOPMENT 


Physical Resource Sharing / 
(reciprocal privileges)* 


Planning Stage* 


Cooperative Policies 
(acquisition, etc.)* 


Development Stage* 


Information Services* 


Operational Stage* 


Centralized Processing* 




Other* 


FUNDING SOURCE 


Funding by Dues or Fees* 


DIRECT SERVICES FROM HEADQUARTERS 


Funding by Grants* 


Direct Services to Faculty* 


Funding by Contributed Resources* 


Direct Services to Graduates* 


\ 

FUNDING LEVEL (ANNUAL) 


Direct Services to Headquarters* 


Direct Services to Others* 


$30*000 or less 


31,000 to 70,000 


LEADERSHIP 


71,000 to 110,000 


Full time Director 


110,000 to 150,000 


Part-time Director 


over $150,000 


No Director 


TYPE OF AGREEMENT 
Legal Agreement 


Informal Agreement . 




*Not mutually exclusive 





Figure 4. Composite Consortium Model 
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I a. LIBRARY CONSORTIUM (WITHOUT HEADQUARTERS) b. LIBRARY CONSORTIUM 'WITHOUT HEADQUARTERS! 

! WITHIN EDUCATION CONSORTIUM 





c. LIBRARY CONSORTIUM (WITH HEADQUARTERS) d. LIBRARY CONSORTIUM (WITH HEADQUARTERS) 

WITHIN EDUCATION CONSORTIUM 



LEGEND 



.WARY FLOW OF LIBRARY-RELATED 
INTERACTION AND MATERIALS 



1 Q LIBRARY 

| r~~~l CENTRALIZED HEADQUARTERS 

•Q MEMBER OF EDUCATION CONSORTIUM 

; s.' 

r-^_- EDUCATION CONSORTIUM CENTRALIZED 
lirr-dj HEADQUARTERS 



Figure 5. Simplified Model of Library Consortia Structur es 
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CONSORTIUM 1 
(ACADEMIC LIBRARIES) 



CONSORTIUM 5 
(ACADEMIC AND PUBLIC 
LIBRARIES) 







EDUCATION CONSORTIUM CENTRALIZED 
HEADQUARTERS 
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Figure 6 . Possible Interrelations of Libraries and Consortia 
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What we have described is a snapshot picture, and the consortia of the case 
studies (and probably the rest) are constantly in a stala of flux, i.e., 
considering new activities and new cooperative arrangements for mutual benefit. 
Indeed, the library community is showing its awareness of the enormity and 
complexity of the area of cooperation. Library schools are beginning to teach 
classes on this subject at the master’s level, and to offer seminars at the 
doctoral level. In addition, ALA has jointly sponsored a conference on the 
topic of interlibrary communications and information networks. The 
number of academic library consortia will no doubt grow as a result of the 
continuing establishment of education consortia, of which libraries are then 
an important component. If voluntary cooperation does not occur, mandatory 
coordination may result. In fact, an important study finding is the 
current lack of coordination among consortia. Many of the librarians did not 
know of consortia developments outside their own area. One library consortium 
director strongly felt the need of national leadership in coordinating what 
has developed from this grass roots movement, in order to bring to fruition 
the electronic national library networks that have been forecast since the 
EDtJCOM conference. As potential candidates for leadership he suggested 
the newly formed National Commission on Libraries and Information Science, 
EDUCOM, or the Library of Congress, Furthermore, the efforts of academic 
library consortia have to be considered in relation to our library consortia 
(e.g., special, public, mixed), as well as to state plans such as the one 
being proposed for California, 

Faint glimmers of developing into networks of national scope can already be 
seen. For example, in one consortium, several theological libraries have found 
it beneficial to merge their resources. Instead of being small libraries with 
small collections, the merged library Is now the third largest theological 
library in the country. This new library is working on cooperative arrange- 
ments with a large state university, as well as a large private university; 
it is also considering the development of a national network of theological 
libraries. This example is only one highlight of exciting possibilities that 
exist, 

erJc 31 



27 



However, a note of caution must be introduced, and a closer look taken at the 
actual accomplishments of existing consortia. Although the following state- 
ment has been made in relation to education consortia, it pertains to library 
consortia as well. 

"The notion is that little or no additional operational 
costs are required for cooperative programming. However, 
if a particular program requires little or no additional 
resources, the significance and/or peripheral nature of 
that program is questionable. To state the point bluntly, 
interinstitutlonal programs are not developed and admin- 
istered without an investment of manpower, money, and 
other resources whether they are centralized or decen- 
tralized. This is recognized in Title III (Higher 
Education Act, 1965) by the allowance of 15% for indirect 
(overhead) costs," Cl) 



in Table 2, we indicate the extent to which academic library consortia 
are engaged in consortium activities. Judging from these statistics 
and from the case studies, the activities most frequently engaged in 
are: the production of union catalogs or lists, and the sharing of 

resources (library staff, as well as materials). Resources are jointly 
developed, then added by external funding. Except for the latter acti- 
vity, most of the activities can be characterized as seemingly low-cost, 
low-compromise, and high-benefit, with identifiable and tangible results. 
Host of the librarians interviewed were enthusiastic about their accomplish- 
ments and felt that their consortium was successful. Even several who were 
not satisfied with the consortium of which they were members, spoke highly 
of cooperation and, although a few had withdrawn from one consortium, they 
were involved in-—or planning to establish — another one better suited to 
their needs. 



Patterson, Lewis D. , Consortia in American higher education . Report 7, 
November 1970, ERIC Clearinghouse on Higher Education, Washington, 

| i/j ( < D.C, , 1970, p - 6 • f-tf 
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TABLE 2. LIST OF LIBRARY CONSORTIUM ACTIVITIES 



J— *- — — — — -- 


Number of 




Number of 






Consortia 




Consortia 






Currently 




Planning or 






Operating 




Developing 


Percent 


Activity 


Activity 


Percent 


Activity 


Reciprocal borrowing privileges 


97 


78 


4 


3 


Expanded interlibrary loan 
service 


80 


64 


9 


7 


Union catalogs or lists 


78 


62 


24 


19 


Photocopying services 


72 


58 


11 


9 


Reference services 


50 


40 


16 


13 


Delivery services 


44 


35 


14 


11 


Mutual notification of purchase 


40 


32 


23 


18 


Special communications services 


35 


28 


12 


10 


Publication program 


34 


27 


14 


11 


Catalog card production 


34 


27 


12 


10 


(Other) Cataloging support 


33 


26 


18 


14 


Joint purchasing of materials 


30 


24 


29 


23 


Assigned subject specialization 
in acquisitions 


28 


22 


33 


26 


(Other) Acquisitions activities 


22 


18 


21 


17 


Microfilming 


21 


17 


9 


7 


Central resource or storage 
center 


21 


17 


11 


9 


Bibliographic center 


17 


14 


16 


13 


Joint research projects 


17 


14 


18 


14 


Clearinghouse 


15 


12 


13 


10 


Personnel training 


15 


12 


21 


17 


User orientation programs 


14 


11 


13 


10 


Other 


9 


7 


6 


5 


Bindery services 


7 


6 


4 


3 


Recruitment!- programs 

: - — — ■ — — 


6 


5 


j 5 


1 4 . 
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Criticism levied against individual librarians still pertains when libraries 
join together to work as a larger unit. There exists evidence of lack of 
» Sufficient planning 

• Quantitative analysis 

• Assessment of user needs 



This study has revealed that consortium arrangements are highly beneficial; 
however, librarians undertaking cooperative activities should be fully aware 
of the difficulties involved. The Five Associated University Libraries (PAUL) 
consortium, which the SDC interviewers have felt to be successful, made 
the following statement* 



"The greatest lesson the Committee as a group has 
learned has been to realize the fantastic complexity 
involved in the most simple inter-institutional act. 
Each project interlocks in some way with every other 
project and the effects are not always clear. 
Accurate and timely communlca t ion is of utmost 
Importance; procedures must be minutely but simply 
contrived, and deadlines met. Member libraries 
must be able to formulate responses to proposals 
quickly and the right staff people should be com- 
mitted to projects and given enough time to work 
on them. 



"The difficulties presented by the geographical 
dispersion of the committee members make frequent 
meetings a real hardship both in terms of time and 
travel fund drain. To make the group work well 
through frequent personal contact is the greatest 
stimulator of ideas and should be continued. 



"The personal problems Committee members had In 
maintaining local performance and doing valuable 
Committee work were in some cases severe. FAUL 
work is viewed as overload. This means that 
FAUL projects necessarily become secondary to 
local job pressures. The only alternatives to 
alleviate this is to spread the work, reduce it, 
or increase the manpower available in the FAUL 
Central Office." (1) 



(1) Five Associated University Librarleav flnter library access; a two-year 
0 report of the FAUL access committee. Five Associated University 

ERIC Libraries, Syracuse, 1968-1970. p. 30, 
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B. FINANCIAL SUPPORT 

The funding levels of the 47 consortia who reported their budgets are presented 
In Table 3, The mean of the budgets is $75,000. Fifty percent of the respon- 
dents (18% of the total consortia) reported that they operate on budgets of 
less than $75,000, 

Interestingly enough, 54 percent of the consortia report that they have no 
formal budget. Judging from the sample, members of consortia that have no 
identifiable budget carry out cooperative activities with their regular staff 
and do not know how much the activity is actually costing. 

The 125 library consortia in the survey were asked how many years in advance 
they could accurately predict (within about 10 percent) the consortium's 
operating budget. Their responses are summarized in Table 4. Sixty-one (78 
percent) of the people who answered this question indicated that they could 
not predict the operating budget in advance, or for more than 1 year. Some 
of the reasons given were ; 

- — The legislature usually passes the current operating budget in 
the current fiscal year. 

— We aim at targets of opportunity within the constraints of existing 
library funds. 

— Funding source has an uncertain budget. 

—None of us has been gifted with prophetic powers, 

—No funds are involved. 

—Federally funded. 

—Programs cannot always be definitely scheduled for more than a year 
in advance. 

--Given the present economic conditions and resultant plight of educa- 
tional institutions, budget predictions are difficult. 

—Grants are unpredictable. 




33 6 ' 



ERIC 



31 



TABLE 3, CONSORTIA FUNDING LEVELS 



SIZE OF OPERATING BUDGET (DOLLAR) 


NUMBER OF 
CONSORTIA 
IN INTERVAL 


PERCENT 


Less than 15 ,000 


11 


9 


15,000 - 30,000 


3 


2 


30,001 - 45,000 


5 


4 


45,001 - 60,000 


4 


3 


60,001 - 75,000 


2 


2 


75,001 - 90,000 


2 


2 


90,001 - 105,000 


1 


1 


105,001 - 120,000 


2 


2 


120,001 - 135,000 


5 


4 


135,001 - 150,000 


1 


1 


150,001 - 165,000 


0 


0 


165,001 - 180,000 


2 


2 


180,001 - 195,000 


1 


1 


195,001 - 210,000 


0 


0 


210,001 - 225,000 


1 


1 


Greater than 225,000 


7 


6 


No Answer to Questionnaire Item 


78 


58 
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TABLE 4. CONSORTIUM OPERATING BUDGET ADVANCE PREDICTION TIME 



PERIOD OF TItffi IN ADVANCE THAT 
BUDGET CAN BE PREDICTED 



5 Years 
4 Years 
3 Years 

2 Years 
I Year 

6 Months 

3 Months 
Other 

Can * t be Predicted 

No Answer to Questionnaire Item 

Total 



NUMBER OF 
CONSORTIA 


PERCENT 


1 


1 


1 


1 


2 


2 


11 


9 


31 


25 


2 


2 


2 


2 


2 


2 


26 


21 


47 


38 


125 
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Budget is subject to annual submission and passage (from a theological 

consortium) . 

— Consortium is too new. 



Closely related to the problem of determining how much financial support is 
required is determining the source of the money. The two major types of fund- 
ing are internal, coming from the consortium members, and external, coming from 
the Federal, state, or municipal government or from foundations. 

Internal funding is obtained from dues paid by members, from fees for ser- 
vices or products, or both. Dues and fees as sources of funds are described 
below, 

1. Dues , Dues from member libraries or ther parent institutions are the 
major funding source for approximately 42 percent of the total funds 
for 61 responding consortia (see Table 5.) Membership dues vary with 
the consortium in a range of from $25 per member (to cover postage and 
stationery) to $10,000 (to cover research and development of computer- 
ized library systems) * Members may be charged equal dues, especially 
if the member institutions are of equal size or have equal financial 
support* In cases where institutions represent diverse financial 
considerations, an alternative is to use a formula, e ,g. , a percentage 
of the book budget* 

One drawback of the formula system is that larger institutions pay a 
larger fee, and in many cases also contribute a larger amount of the 
resources being shared. They may thus expect greater consideration in 
the selection of projected consortium activities, 

2, Fees * In some kinds of consortia, members are charged fees for services 
or products* For example, for shared cataloging, members might be 
charged on the basis of the use of the central file for cataloging 
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TABLE 5, 



SOURCE OF MAJOR FUNDING 



( 1 ) 



SOURCE 


APPROXIMATE PERCENT 
OF TOTAL FUNDING 


Dues from member libraries or their parent 
institutions 


42 


Service fees from member libraries or their 
parent institutions 


10 


Service fees from individual users 


2 


Gifts 


3 


Continuing government appropriations 
(Federal, state, and local) 


28 


Nongovernmental grants 


1 


Othar 


14 


^■^61 out of 125 consortia responded to this question. 



information; for technical processing, the charge might be based on 
the number of catalog card sets produced. One problem with this 
method is that funding is required to keep the activity in operation 
until the fees are received. (As shown in Table 5, service fees 
from member libraries or their parent institutions represent 10 percent 
of the source of funds for the 61 consortia who responded to this 
question; service fees from individual users represent 2 percent. 

3. Combined . Only 5 of the 125 library consortia indicated that their 
funds are based on dues paid by members as well as fees for services 
or products. 

* 39 
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External funding is obtained through Federal, state, or municipal support. In 
addition, a library consortium may receive some money from a larger educational 
consortium of which it is a member j this money might consist of Title IIIC funds, 
or of dues charged by the parent institution. Since library budgets are usu- 
ally the first to be cut in a recession, many libraries are cooperating because 
of economic necessity, and some of these consortia could not have been started 
without government assistance. In addition, many of the larger cooperative 
research and development projects could not have been undertaken without external 
funding. Although external funding can be of great use to a consortium, note 
that only 32.9 percent of all the funding for the 61 responding consortia is 
external. The general feeling among librarians interviewed was that it was 
unwise to rely solely on external funding. 



One consortium peinber was extremely proud of the fact that all their funding 
was internal, since he felt it was easy to cooperate on someone else’s money. 

In another consortium, one librarian felt that if Federal funding were to stop, 
they would not be able to continue operating, inasmuch as librarians could not 
contribute money to consortium activities because of reduced budgets. 



In yet another consortium, members found it easier to cooperate when the project 
was externally funded. When funding stopped and they were expected to support 
the project from their own budgets, they examined the benefits and costs 
closely, becoming more critical of the project than previously. 
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C. EVALUATION OF CONSORTIUM OPERATIONS AND BENEFITS 

Evaluation is, or should be, an important part of any 1 cooperative s work. 

In the questionnaire survey of 125 academic library consortia, library consortia 
directors or chairmen were asked to indicate which techniques they used to 
evaluate the effectiveness of their library consortium activities. As shown in 
Table 6, the most often used evaluative technique consisted of Informal 
feedback from library personnel participating in consortium activities 
(66 percent) , and from the ultimate users of services (49 percent). 

More formal methods of evaluation were less frequently usedi for example, 
analyses of cost and usage statistics (29 percent) ; formal surveys of 
operations at the participating libraries (21 percent) ; operations research 
analyses such as work flow, cost effectiveness tradeoffs, etc., (13 percent), 
and formal surveys of the ultimate users of consortium services (10- percent) , 
During the in-depth studies, it was possible to gain better insight into how 
these various methods of evaluation were used, which activities they were most 
often used for, and how well they worked, as well as some feeling for ways 
in which their use could be improved. 



As in the questionnaire, informal feedback was the evaluative method most 
often used. Informal feedback is difficult to define; it could mean that a 
certain number of users were satisfied with a particular consortium service 
and expressed this satisfaction to the librarians; it could also refer to a 
certain n umb er of librarians who were satisfied or dissatisfied with a service, 
and took the time to make their feelings known. However, informal feedback 
does not necessarily account for people who could be using the service but 
are not, because they do not know it is available, or because the service 
may not really be meeting their needs. 
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TABLE 6. TECHNIQUES USED BY CONSORTIA TO EVALUATE ACTIVITY EFFECTIVENESS 



EVALUATION TECHNIQUE 


NUMBER OF CONSORTIA 
USING TECHNIQUE (1) 


PER- 

CENT 


Informal Feedback from Library 
Personnel Participating in Consortium 
Activities 


82 


66 


Informal Feedback from the Ultimate 
Users of Services 


61 


49 


Analyses of Cost and Usage Statistics 


36 


29 


Formal Surveys of Operations at the 
Participating Libraries 


26 


21 


Operations Research Analyses 

(e.g. Work Flow, Cost Effectiveness 

Tradeoffs) 


16 


13 


Formal Surveys of the Ultimate Users 
of Consortium Services 


13 


10 


Other 


5 


4 


No Answer to Questionnaire Item 


33 


26 


/■^Many consortia used several evaluation techniques. 
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Feedback is necessary and can greatly aid the evaluation and eventual Improve- 
ment of any library consortiton activity! however, it is important to ensure 
that feedback will be collected systematically, that it will reach the 
proper people, and that something be done about it. Librarians or system 
designers engaged in consortium activities can obtain feedback from records 
of the extent to which any activity is used, surveys of users and librarians, 
and continuous review of cost and benefits. For example, consider a consortium 
objective such as sharing resources, which is usually achieved by means of 
expanded interlibrary loan and reciprocal borrowing privileges. The members 
of several consortia in the sample who had recorded the usage figures were 
able to state that interllbrary loan circulation among members had increased 
as a result of consortium agreements. Other consortia had not kept these 
kinds of records, but intuitively felt that interlibrary loan among members 
had increased. With regard to reciprocal borrowing privileges, we did not 
encounter any consortia that systematically kept records of the extent to 
which this new service was being used. Here again, as in the case of expanded 
interllbrary loan, the librarians' intuitive feeling was that it was working 
well, and that users were satisfied. Although it may be too expensive to 
provide continuous monitoring of usage for certain activities, a representative 
sampling of usage statistics would facilitate an evaluation of the added 
costs and benefits. 

Several consortia evaluated the benefits of the Increased library resources 
now available to users by totalling the collections of all the member libraries. 
It may be impressive to state that the user now has access to X thousands of 
volumes, but the relevant question is, "Are these the resources the user needs, 
and is he using them?" 

The more formalized methods of evaluation such as analyses of cost and 
usage statistics, formal surveys of operations of the participating 
libraries and of users of consortium services, and operations research 
analyses, were most often used by consortia engaged in large-scale computerized 
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activities. This evaluation was sometimes carried out by a consultants or 
by the centralized headquarters consortium staff, as an evaluation performed 
by outsiders could understandably be a possible cause of dissension. One 
consortium’s solution was to have each library staff see and approve any 
statistics collected at their library. 



In addition to evaluating the effectiveness of particular consortium activities, 
consortia need to make an overall evaluation of how well they are meeting their 
objectives. Host of the consortium members interviewed felt that their con- 
sortium was successful, as judged by some of the following criteria! 

1. Present members remained in the consortium and continued to 
contribute time or money. 

2. New members were joining the consortium. 

3. The consortium was able to obtain Federal or other external funds. 

4. The consortium was able to survive without external funds, or after 
external funds had ceased. 

5. Consortium activities were providing new and/or improved services for 
the library users . 

Costs had been reduced. 

However, the success of several of the consortia in the sample could be 
questioned. In one case, the consortium had been formed primarily to be 
eligible for Federal funds; when the funds ceased, the consortium had no money 
to un dertake any new projects. Another consortium was achieving its stated 
objective in that the intended services were being provided; nonetheless, 
considerable dissension exists among the members in that they have not been 
allowed enough involvement in decision-making on crucial matters, and that they 
question the value of benefits received. Whether this consortium will continue 
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is yet. to be decided. The future success of several other consortia is also 
to be determined, but their outlook is more promising. These are the con- 
sortia engaged in large-scale computerized activities and undergoing a 
transition from research and development to a fully operational environment. 

The SDG questionnaire survey and the in-depth case studies indicated that the 
evaluation of consortia and consortia activities is not extensive. The survey 
also indicated that 54 percent of the consortia have no identifiable budget. 
One likely interpretation is that librarians are participating in consortium 
activities in addition to their regular library activities. Thus the time 
and money they have to plan, to develop, and to evaluate consortium activi- 
ties is limited. At the end of a long, 4-1/2-hour interview, we Lhanked one 
of the librarians for the time he had spent with us and for his thoughtful 
answers. He said that he had enjoyed the interview because of the opportunity 
it had given him to reflect; in the rush of day-to-day activities, he had no 
time to do this. Several of the other librarians said that the questions 
were a good evaluation exercise and enabled them to reexamine the consortium 
activities. Although time may be limited* — and, in fact, especially because 
time may be limited — it is vitally important that librarians make a careful 
evaluation of the costs and benefits of cooperative activities. By doing 
so, they will help not only themselves but also the many libraries in the 
Nation that might benefit from cooperative activities and that lack only 
the necessary descriptive and evaluative information to appraise their alter- 
natives and take the next steps. 
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D, OTHER FINDINGS OF THE STUDY 

This section of the Final Report has touched only on some of the many 
aspects of consortium activities explored in the full SDC study. For 
a much more complete picture of these activities and their implications 
f qj; the development of new consortia, the reader is referred to the 
Guidelines for the Development of Academic Library Consortia. 







V. DISSEMINATION OF FINDINGS 



A. LIAISON WITH THE LIBRARY COMMUNITY 

Throughout the project we have had numerous requrests for information about 
the scope of work being performed and results of the analysis being conducted. 
We have answered every letter and have endeavored to supply all the information 
requested. In addition, through correspondence with state librarians and 
the various consortia being studied, project activities have been made known 
to all who have inquired. 

Two requests for talks were received in November 1971, one for the ALA 
Midwinter meeting in Chicago, in January 1972, and one for the Rochester 
Regional Research Library Council, in June 1972, The talks will be given by 
the 5 DC Project Director and/or Assistant Project Director, 



B. PUBLICATION OF PROJECT MATERIALS 

Hundreds of persons have requested copies of the Directory and of the 
Guidelines . For that reason, after conferring with USOE, it was decided 
to solicit the interest of a commercial publisher so that the Directory 
and the Guidelines could be made widely available. Seven publishers were 
contacted with regard to the Directory , Two of them made firm expressions 
of interest, and they were subsequently invited to review the Guidelines 
for possible publication, A deadline of December 13, 1971 was set for bids 
from the two publishers. After these bids are received, SDG will make a 
recommendation to USOE and thereafter assist the selected publisher in 
effecting timely distribution. Completion of the publication arrangements 
will mark the completion of the project. 
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APPENDIX B 

ABSTRACT AND TABLE OF CONTENTS, GUIDELINES 
FOR THE DEVELOPMENT OF ACADEMIC LIBRARY CONSORTIA 



This document is one of the products of the Study of Academic Library Consortia 
conducted by System Development Corporation under contract to the U.S, Office 
of Education. The purpose of the Study was to make available information on 
the activities of various academic library consortia and to provide guidance 
for libraries that are forming or planning to form consortia. 

Phase I of the Study comprised two questionnaire surveys aimed at identifying 
and listing all academic library consortia in the United States. Data from 
the questionnaires were compiled in a Directory of Academic Library Consortia . 
Phase II of the Study involved a case-study analysis of 15 selected academic 
library consortia. Data were gathered by means of field interviews and were 
combined with the survey data to produce this document. Guidelines for the 
Development of Academic Library Consortia . 

This Guidelines document presents and discusses the developmental steps re- 
quired in establishing a consortium and, where possible, provides criteria 
for the many decisions that must be made. Consortium development is divided 
into four phases : 



• Exploratory Phases Involves activities aimed at deciding 

whether to establish an academic library 
consortium 



© Planning Phases Includes the selection and approval of 

objectives, program plans, financial 
support, and organizational structure 



• Development Phases 



Includes all design and development tasks 
for consortium activities 



• Operation and Includes the operation of consortium activ- 

Evaluation Phases j ities and the evaluation of consortium 

/ performance . 

A total of 24 devel opmei/t al steps are grouped under the four phases of con- ** 
sortium development listed above. The Information included under each step 
is a combination of descriptive material-- discus sing the various ways in which 
the step has been accomplished by various consortia— and prescriptive material — 
prescribing ways of accomplishing the step that seem most desirable in the light 
of the evidence gathered during the study. 



A careful perusal of this Guidelines document will enable a potential consortium 
to determine the most likely path for its group development efforts. 
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